Scaling Properties of Neural Networks for the Prediction of Time Series

Scaling properties of neural networks, that are the relations between the number of hidden units and the training or generalization error, recently have been investigated theoretically with encouraging results. In our paper we investigate experimentally, whether the theoretic results may be expected in practical applications. We investigate different neural network structures with varying number of hidden units for solving two time series prediction tasks. The results show a considerable difference of the scaling behavior of multi layer perceptrons and radial basis function networks.